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MFTHOD AND APPARATUS FOR COMMUNICATION NETWORK CLUSTER 
FORMATION AND TRANSMISSION OF NOD E LINK STATUS MESSAGES WITH 
REDUCED PROTOCOL OVERHEAD TRAFFIC 

1 CROSS-REFER FNCE TO RELATED APP LICATIONS 

2 This application claims priority from U.S. Provisional Patent Application Serial Nos. 

3 60/1 64,955, entitled "Cluster Algorithm for Ad Hoc Wireless Network" and filed November 1 2, 

4 1999, and 60/164,942, entitled "Routing Algorithm for Ad Hoc Wireless Networks" and filed 

5 November 12, 1999. The disclosures of those provisional applications are incorporated herein 

6 by reference in their entireties. 

£y BACKGROUND OF THE INVENTION 

9j5 1. Technical Field 

1(2 The present invention pertains to communication systems. In particular, the present 

1 lU invention pertains to a wireless communication system utilizing network topology information 

\%h to form clusters fqr data transmission by a minimal quantity of hops and without regard to initial 

if? start times of network nodes. In addition, the present invention pertains to a wireless 

1 ki communication system employing cluster formation to form a multiple tier network architecture 

1 £■ and facilitate transmission of node link status messages with reduced protocol overhead traffic. 

16 2. Discussion of Related Art 

1 7 Generally, certain wireless networks, such as a cellular network, commonly utilize a relay 

1 8 station to forward a message from a mobile cellular unit to a desired destination. The relay 

19 station is typically a fixed base station where each mobile unit transmits an outgoing message 

20 directly to the base station (e.g., the base station is generally within one hop from the mobile 

21 units) for forwarding through a public telephone network to the desired destination. Ad hoc 

22 wireless networks (e.g., dynamic wireless networks without any routing infrastructure) are 

23 typically employed for military and personal communication applications. These types of 

24 networks do not include fixed base stations, but rather employ nodes that each dynamically 

25 determine a relay type network node to route traffic. Thus, the ad hoc network node is provided 

26 with a difficult task of determining a routing path for data transmission. Since several hops are 

27 typically required to facilitate communications, the cellular scheme described above is 
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1 insufficient for ad hoc networks. 

2 The related art has attempted to overcome the aforementioned problem by providing flat 

3 and hierarchical network architectures for data routing. In particular, the flat architecture 

4 basically includes a single tier of network nodes in communication with each other. The flat 

5 architecture performs adequately with small scale networks, however, overhead traffic increases 

6 rapidly and exceeds network capacity in response to increasing network size. The hierarchal 

7 architecture basically arranges a network into plural tiers or hierarchical levels. The first tier 

8 typically includes clusters or cells each including a plurality of communication nodes or cluster 

9 members. One node within each cluster is designated as the cluster head and has full 

10 connectivity to corresponding member nodes. The second tier includes a backbone network 

1 1 formed of the cluster head nodes to enable communications between different clusters (e.g., for 
12U data transmitted over greater distances). Thus, the first network tier represents each network 
12ffi node, while the second network tier represents cluster head nodes. In operation, a network 
143 member node initially transmits a message to its corresponding cluster head node which 
1 JS subsequently forwards the message through the backbone network (e.g., through plural hops of 
1 <jE cluster head nodes) to a destination cluster head node associated with a destination member node. 
17 Since full connectivity exists between each cluster head node and its corresponding member 
1 E nodes, the destination cluster head node transmits the message to the corresponding destination 

1 member node. This type of architecture is typically employed in communication networks for 
2S0 military applications. 

2 f The formation of clusters and designation of cluster head nodes is generally performed 

22 dynamically within the exemplary hierarchical network, while the network employs a routing 

23 protocol to facilitate communications within the network. The routing protocol is preferably a 

24 link-state type of protocol that is implemented on the backbone network (e.g. , by the cluster head 

25 nodes). The cluster head nodes each include a database that has information enabling the cluster 

26 head nodes to determine appropriate paths for routing messages. In particular, each head node 

27 constructs a routing table to determine a successive link to transmit a message from that node 

28 toward a destination head node. This is accomplished by transmitting or flooding routing 

29 information from each head node database among cluster head nodes to synchronize those 

30 databases. In order to ensure receipt of database information, a receiving head node transmits 

31 an acknowledgment message to a source head node transmitting the database information. If an 
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1 acknowledgment message is not received within a predetermined time interval, the database 

2 information is re-transmitted to the network head nodes that have not acknowledged receipt of 

3 the database information. In addition, each network node (e.g., cluster head and member nodes) 

4 periodically broadcasts a beacon type or node status packet in accordance with the routing 

5 protocol. This packet basically advertises the presence of a node within the network, and is 

6 typically utilized by cluster head nodes for "keep alive" and neighbor discovery purposes. 

7 In order to facilitate internet routing or routing between the hierarchical and other external 

8 networks (e.g., the Internet), a modified version of the conventional Open Shortest Path First 

9 (OSPF) Protocol may be employed. The OSPF protocol is basically a routing protocol employed 

10 for Internet Protocol (IP) type networks, while the modified protocol or Radio Open Shortest 

1 1 Path First (ROSPF) protocol is similar to OSPF, but is adapted for use with radio or wireless 
12- networks. For examples of implementation of the OSPF Protocol, reference is made to RFC 
1 $0 1 583, Moy, "OSPF Version 2," March 1 994, the disclosure of which is incorporated herein by 
143 reference in its entirety. 

1 Routing is accomplished in the OSPF protocol by each network node having a routing 

10 database containing information related to network topology (e.g. , links between network nodes). 
1 f The routing database is utilized by each node to determine a path for transmitting a message to 
]K a destination site. The routing databases are updated by exchanging Link-State Advertisement 
15: (LSA) packets between neighboring nodes. These packets generally include information related 
20 to current links of network nodes and are typically transferred periodically and/or in the event of 
2T a modification to the network topology. The OSPF protocol designates a particular router to 

22 flood LSA packets to neighbors in broadcast type networks, while LSA packets are transmitted 

23 via point-to-point within non-broadcast type networks. The ROSPF protocol employed by the 

24 hierarchical network described above is similar to the OSPF protocol and exchanges LSA type 

25 packets between neighbors (e.g., cluster head and member nodes) to synchronize routing 

26 databases as described above. 

27 The hierarchical architecture may provide significant reduction in routing overhead 

28 traffic in relation to the flat architecture depending upon the quantity of cluster head nodes 

29 employed. Accordingly, the related art provides several clustering techniques to arrange a 

30 network into a hierarchical architecture. Initially, a cluster head node may be utilized to replace 

3 1 the functionality of a cellular network base station and basically serves as a pseudo base station 
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1 for data traffic within a corresponding cluster. A technique of the related art for cluster head 

2 designation and subsequent cluster formation includes determining clusters based on identifiers 

3 (e.g., identification codes or numbers) of network nodes. This technique basically designates a 

4 network node having a lowest (e.g., or greatest) node identifier as a cluster head. The related art 

5 has expanded this technique to utilize a node identifier or a degree of node connectivity to 

6 designate a cluster head node, and has further modified the technique to employ interconnected 

7 non-overlapping clusters to cover an entire network. 

8 In addition, clustering techniques have been employed for military communication 

9 applications and provide a basis for routing protocols. One such technique determines cluster 

10 head nodes in accordance with initial random start times of network nodes. Basically, each 

1 1 network node may initiate power or start up at various times, thereby providing a generally 
12=. random node initiation sequence. A network node is designated as a cluster head node in 
ifi response to node initiation and determining the absence of neighboring nodes. Thus, nodes 
1 €3 having early initiation times tend to be designated as cluster head nodes by this technique. The 
1 U routing protocol commonly designates cluster head nodes and forms clusters based on network 
1 §; node identifiers (e.g., lowest node identifier is designated as a head node) and certain designation 
1? rules. 

l|T The clustering techniques of the related art suffer from several disadvantages. In 

& particular, the above clustering techniques generally utilize simple criteria to dynamically 

2£§ designate a cluster head without employing network topology information. In particular, the 

if techniques typically designate a cluster head node based on lowest or greatest node identifier. 

22 However, this may result in no direct links between cluster head nodes, thereby requiring 

23 additional gateway type nodes (e.g., nodes having communications with two cluster head nodes) 

24 to facilitate communication between clusters and increasing the quantity of hops required for 

25 communication. The approach according to node random start times may designate a significant 

26 quantity of nodes as cluster head nodes, where the designations are typically not optimal 

27 selections for a network configuration. Further, this cluster formation technique depends upon 

28 the particular sequence of node initiation, thereby enabling particular initiation sequences to 

29 facilitate a formation failure. Moreover, the above clustering techniques complicate 

30 determination of an appropriate interval between node status packet transmissions. When the 

3 1 interval is set to a value below an acceptable range, large scale networks may become congested. 
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1 Conversely, if the interval is set to a value above an acceptable range, an extensive time interval 

2 is required to complete cluster formation. In addition, the above clustering techniques typically 

3 require the initial start times of network nodes to be spaced apart a sufficient interval in order to 

4 avoid network failure as the quantity of nodes within the network increases. 

5 With respect to the network architectures for data routing, the flat architecture performs 

6 adequately for small scale networks, but as network size increases, the flat network rapidly 

7 becomes congested since overhead traffic increases exponentially with network size. The 

8 hierarchical architecture reduces overhead traffic relative to the flat network architecture, 

9 however, this reduction is insufficient when the network employs on the order of several hundred 

1 0 nodes, thereby limiting application of the routing protocol. Although reliability of flooding node 

1 1 database information throughout a network is enhanced by transmission of acknowledgment 
12- messages, these messages increase overhead traffic, thereby degrading network performance. 
13O The present invention overcomes the aforementioned problems by utilizing network 
1 43 topology information to identify network nodes crucial for relaying traffic. The identified nodes 
llK are designated as cluster head nodes, while remaining nodes are designated as member nodes. 
1 jP Since cluster head nodes basically serve as relay nodes, the present invention removes the need 
i f for gateway type nodes. In other words, the present invention designates a minimum quantity 
l£ of network nodes as cluster head nodes to achieve connectivity among the nodes. Since the 
1*T present invention employs a deterministic approach, cluster formation remains substantially the 
2£B same independently of the initial start-up sequence of network nodes. Further, the designation 
if of cluster head nodes by the present invention is optimal since the designated nodes are crucial 

22 for relaying network traffic. Moreover, since the quantity of cluster head nodes that may 

23 facilitate communications depends upon the interval between node status packet transmissions, 

24 the present invention adaptively adjusts that interval to subsequently facilitate cluster formation 

25 independent of network size and varying start times of network nodes. 

26 In addition, the present invention employs a cluster formation technique to form a three 

27 tier hierarchical network in order to apply the routing protocol to large scale networks. The 

28 cluster formation technique is applied to the cluster head nodes or backbone network to form 

29 third tier clusters. Nodes within the third tier distribute routing information from head node 

30 databases to reduce overhead traffic, while head nodes within the second tier are utilized for data 

3 1 routing. Further, the present invention reduces overhead traffic by eliminating transmission of 
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1 acknowledgment messages in response to receipt of the database information. Basically, the 

2 present invention examines head node databases and requests third tier nodes to supply missing 

3 information. Thus, the present invention only sends request messages in response to receipt of 

4 the database information and discovering missing data within head node databases, thereby 

5 significantly reducing overhead traffic. 

6 OBJECTS AND SUMMARY OF THE INVENTION 

7 Accordingly, it is an object of the present invention to facilitate cluster formation in 

8 accordance with network topology information to minimize the quantity of hops for data 

9 transmission within the network. 

10 It is another object of the present invention to form clusters within a network while 

1 1 designating a minimum quantity of cluster head nodes, thereby reducing the quantity of hops and 
1 2L overhead traffic for data transmission. 

\ 33 Yet another object of the present invention is to enable cluster formation independent of 

1 4^ initial start times of network nodes. 

1 jgj Still another object of the present invention is to form an additional network hierarchical 

1 S3 tier to transmit routing information from node databases throughout the network with reduced 

1 f overhead traffic. 

llf A further object of the present invention is to employ a three tier network architecture to 
facilitate transmission of routing information from node databases throughout the network with 

2§5 reduced overhead traffic. 

2p The aforesaid objects may be achieved individually and/or in combination, and it is not 

22 intended that the present invention be construed as requiring two or more of the objects to be 

23 combined unless expressly required by the claims attached hereto. 

24 According to the present invention, an exemplary wireless network includes a plurality 

25 of nodes arranged by the present invention into clusters with each cluster having cluster member 

26 nodes and a designated cluster head node. The nodes communicate with each other via a link- 

27 state type of routing protocol and may further communicate with other external networks in 

28 accordance with an internetworking protocol (e.g., a modified version of the conventional Open 

29 Shortest Path First (OSPF) routing protocol, or a Radio Open Shortest Path First (ROSPF) 

30 protocol). A database within each network node contains link information for that node. The 

3 1 present invention facilitates cluster formation within the network by utilizing network topology. 
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1 information to form clusters and designate cluster head nodes. This is accomplished by 

2 identifying nodes that are crucial for relaying traffic within the network and designating those 

3 nodes as cluster head nodes, while remaining network nodes are designated as member nodes. 

4 Further, the present invention adjusts a node status packet transmission rate or interval between 

5 successive node status packet transmissions to facilitate cluster formation independent of 

6 network size and varying initial start times of network nodes. 

7 In addition, the present invention utilizes the above described cluster formation technique 

8 to form a three tier architecture for transmission or flooding of routing information from head 

9 node databases throughout the network. In particular, the cluster formation technique is applied 

1 0 to cluster head nodes to form an additional network tier of super nodes. These super nodes are 

1 1 responsible for distributing the routing information, while cluster head nodes route network data 
12_ traffic. The databases of cluster head nodes are examined subsequent to flooding of head node 
1 3D database information by super nodes, where data missing from a head node database is requested 
1#3 from a corresponding super node, thereby eliminating transmissions of acknowledgment 
1 Jjfi messages. Thus, the present invention achieves significant reduction in overhead traffic. 

1 gj The above and still further objects, features and advantages of the present invention will 

i f become apparent upon consideration of the following detailed description of specific 

lft embodiments thereof, particularly when taken in conjunction with the accompanying drawings 

1^= wherein like reference numerals in the various figures are utilized to designate like components. 

2§j BRIEF DESCRIPTION OF THE DRAWINGS 

ff Fig. 1 A is a diagrammatic illustration of network nodes according to the present invention 

22 arranged in an exemplary communication network. 

23 Fig. IB is a block diagram of a network node of Fig. 1 . 

24 Fig. 2 is a procedural flow chart illustrating the manner in which a network node adjusts 

25 the interval between node status packet transmissions according to the present invention. 

26 Fig. 3 is a procedural flow chart illustrating the manner in which a network node receives 

27 and processes node status packets according to the present invention. 

28 Fig. 4 is a procedural flow chart illustrating the manner in which a network node 

29 determines head or member status to facilitate cluster formation according to the present 

30 invention. 

3 1 Fig. 5 is a diagrammatic illustration of an exemplary configuration of network nodes and 
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1 corresponding clusters formed in accordance with the present invention. 

2 Fig. 6 is a diagrammatic illustration of an exemplary alternative configuration of network 

3 nodes and corresponding clusters formed in accordance with the present invention. 

4 Fig. 7 is a graphical illustration of the relationship between network packet rate and time 

5 for an exemplary network configuration employing cluster formation and adjustment of the 

6 interval between node status packet transmissions in accordance with the present invention. 

7 Fig. 8 is a diagrammatic illustration of an exemplary network having multiple tiers 

8 according to the present invention. 

9 Fig. 9 is a procedural flow chart illustrating the manner in which a network node performs 

10 clustering and determines super node status to form a multiple tier network configuration 

1 1 according to the present invention. 

12^ Fig. 1 0 is a diagrammatic illustration of an exemplary configuration of cluster head nodes 

1 30 and corresponding clusters formed in accordance with the present invention. 
1 £ Fig. 1 1 is a graphical illustration of the relationship between the total quantity of overhead 

1 J packets and the quantity of cluster head nodes for the present invention and conventional 

1© flooding techniques. 

ff DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

ig; Network nodes according to the present invention arranged in an exemplary wireless 

p[ network are illustrated in Fig. 1 A. Specifically, wireless network 2 includes a plurality of nodes 

2g| 10 arranged in cells or clusters 12 in accordance with cluster formation of the present invention 

if as described below. Each cell or cluster includes corresponding cluster member nodes 1 0 with 

22 one of those cluster member nodes designated as a cluster head node 14. These cluster 

23 arrangements form a first tier of network 2 and facilitate communication within a cluster between 

24 the cluster head and member nodes preferably utilizing a first transmission frequency. The head 

25 nodes of each cluster are in communication with each other, preferably utilizing a second 

26 transmission frequency, and form a backbone network 16. The backbone network essentially 

27 forms a second tier of network 2 and facilitates communications between nodes of different 

28 clusters (e.g., generally providing communications over greater distances). The architecture of 

29 network 2 is similar to that of conventional cellular telephone systems, except that network 2 

30 provides dynamic selection of cells and cluster head nodes as described below. 

31 A network node 10 according to the present invention is illustrated in Fig. IB. 

32 Specifically, node 10 includes a transmitter 22, a receiver 24 and a processor 26. The processor 
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1 is preferably implemented by a conventional microprocessor or controller and controls the node 

2 to transmit and receive messages in accordance with the communication protocols described 

3 below. The transmitter is preferably implemented by a conventional transmitter and transmits 

4 messages from the processor, preferably in the form of radio frequency (RF) signals, in 

5 accordance with processor instructions. Receiver 24 is typically implemented by a conventional 

6 receiver and configured to receive signals, preferably in the form of radio frequency (RF) signals, 

7 transmitted by the transmitter of another node. The receiver receives transmitted signals and 

8 forwards the received signals to processor 26 for processing. The node further includes an 

9 identifier (e.g, a code or identification number) to identify the particular node and a database (not 

10 shown) to store information pertaining to neighboring nodes to facilitate cluster formation as 

1 1 described below. A present invention head node 1 4 is substantially similar to node 1 0 described 
\1 = above. 

1 30 The network preferably employs a link-state type of routing protocol that is implemented 

1 4*5 on backbone network 1 6. The database of each head node 1 4 maintains information enabling that 

1S| cluster head to determine appropriate paths for routing messages through the network. The 

1 C3 information typically relates to links between the various network head nodes. The cluster head 
1 T databases are synchronized in accordance with the routing protocol by transference of database 
Iff update packets or messages between cluster head nodes that provide network connectivity 
1^ information. These packets are conventionally transmitted to each neighboring network head 
2R node via plural unicast or point-to-point messages (e.g., messages from a source node to a 
2¥ specific destination network node) in response to changes in network topology, an external 

22 network connected to network 2 or other modifications to the network facilitating changes in a 

23 node database. When a database update packet is received, a point-to-point acknowledgment 

24 (ACK) packet is commonly transmitted to the source node from the destination node to indicate 

25 packet reception. In addition, each node (e.g., cluster head and member nodes) periodically 

26 broadcasts a beacon type or node status packet. This packet basically advertises the presence of 

27 a node within the network and is typically utilized by head nodes for "keep alive" and neighbor 

28 discovery purposes. 

29 With respect to communications between network 2 and other external networks (e.g., 

30 the Internet), the network may employ a Radio Open Shortest Path First (ROSPF) protocol. This 

3 1 protocol is basically a modified version of the conventional Open Shortest Path First (OSPF) 
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1 protocol commonly utilized for Internet Protocol (IP) type networks. Since the OSPF protocol 

2 generates significant overhead when applied to ad hoc networks (e.g., dynamic wireless networks 

3 without any routing infrastructure), such as network 2, that protocol has been modified to derive 

4 the ROSPF protocol suitable for use with wireless or radio networks. According to the ROSPF 

5 protocol, each node within network 2 maintains a routing database including information 

6 enabling the node to determine an appropriate path for routing a message to the external network. 

7 The information contained within the node routing databases typically relates to links between 

8 the various network nodes. The ROSPF protocol is a link-state type routing protocol and 

9 provides for synchronization of node routing databases through transmission of Link-State 

10 Advertisement (LSA) packets to each network node. These packets are conventionally 

1 1 transmitted to each neighboring network node via plural point-to-point messages (e.g., messages 
12_ from a source node to a specific destination network node) in response to changes in network 
l|5 topology, an external network connected to network 2 or other modifications to the network 
144 facilitating changes in a node database. When a database update packet is received, a point-to- 
15g point OSPF type acknowledgment (ACK) packet is commonly transmitted to the source node 
163 from the destination node to indicate packet reception. 

1 f 3 The arrangement of nodes 1 0 within clusters 1 2 and the designation of cluster head nodes 

ljf 14 are dynamically determined by the present invention. Basically, the present invention 

19* facilitates cluster formation and adjustment of the interval between node status packet 

2{£ transmissions within wireless ad hoc type networks. Cluster formation facilitates arrangement 
2P of network 2 into clusters and designation of cluster head nodes to form backbone network 16. 

22 The present invention distributes processing in a manner that enables each network node to 

23 determine its status as a head or member node in accordance with local connectivity information 

24 received within node status packet transmissions from neighboring nodes as described below. 

25 Since the interval between node status packet transmissions is adjusted, the initial value for that 

26 interval is not critical to cluster formation. Generally, the initial interval between node status 

27 packet transmissions is set to a low value to form clusters rapidly. If the initial interval is set to 

28 a value below an acceptable range, the network becomes congested due to transmission of 

29 excessive quantities of node status packets. However, the present invention automatically 

30 increases that interval to relieve the congestion. 

3 1 The manner in which a processor of a network node facilitates transmission of node status 

32 packets and adjustment of the interval between transmission of those packets according' to the 
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1 present invention is illustrated in Fig. 2. Initially, power is enabled to an unconfigured network 

2 2 at step 30 and each network node periodically transmits node status packets at predetermined 

3 time intervals. The node status packets transmitted by each node include a payload or storage 

4 section containing information including the quantity of neighboring nodes associated with that 

5 node and a listing of those neighboring nodes. The quantity of this information typically increases 

6 as node status packets are received by a node and additional neighboring nodes are discovered. 

7 The node status packets are transmitted as a broadcast message to enable each node of a 

8 succeeding hop (e.g., nodes within one hop from the transmitting node) to receive the packets. 

9 Specifically, a node schedules beacon transmission using an initial value at step 32, and 

1 0 subsequently waits for the transmission time of a succeeding node status packet as determined 

1 1 at step 34. In other words, the network node transmits a node status packet *k' (e.g., where k is 

12 generally an integer greater than or equal to zero) at time, t k , and waits for expiration of a time 
ill interval, T k , between time t k and the transmission time of a succeeding node status packet, t k+1 . 
1 £i The time interval between node status packet transmissions, T k , is initially set to a generally low 
1 predetermined value and is adjusted in accordance with network conditions as described below. 
1 <B However, the time interval may be initially set to any desired value. The network node receives 
1 T node status packets during transmission and processes the packets as described below to facilitate 

the interval adjustment. 

1£l In response to expiration of the time interval, a node status packet containing relevant 

2|tj neighbor information is transmitted by the network node at step 36. The node processor 

2P subsequently determines the appropriate interval between subsequent node status packet 

22 transmissions based on the quantity of neighboring nodes indicated within received node status 

23 packets. Basically, the quantity of neighboring nodes generally decreases or remains the same 

24 in the event that no additional neighbors are discovered, or that neighboring node status packet 

25 transmissions are lost due to transmission impairments. In order to enhance the probability of 

26 receiving the potentially lost node status packets, the interval between node status packet 

27 transmissions, T k , is increased to provide sufficient time for reception of the packets. 

28 Specifically, when the quantity of neighboring nodes, N k (e.g., where N is an integer generally 

29 greater than or equal to zero), associated with the network node at a time, t k , is the same as the 

30 neighbor quantity, N k .„ at a previous time, t k . l3 as determined at step 38, the time interval 

3 1 between transmission of node status packets by the network node, T k , is increased at step 42. 
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1 Accordingly, the time for transmission of a succeeding node status packet ,t k+1 , may be expressed 

2 as follows: 

3 t k + , = t k + T k + uniform (8); 

4 where the uniform function represents a uniform distribution. In other words, the transmission 

5 time of a succeeding packet, t k+1 , is determined from the transmission time of a current node 

6 status packet (t k ), a current interval between transmissions (T^) and an offset (8). The offset, 8, 

7 is utilized to coordinate node status packet transmissions of network nodes. Since simultaneous 

8 transmission of node status packets results in collisions, the node status packet transmission 

9 times are staggered among the network nodes to minimize collision occurrence. The offset, 8, 

10 may be any desired value or function to achieve appropriate node status packet transmission 

1 1 times. The uniform function basically distributes the offset values among the nodes in an 

1 2 appropriate manner. The interval between node status packet transmissions of neighboring nodes 
l|h is typically determined by the network node based on the frequency of reception of node status 
1 Jjj packets from those nodes. Thus, the network node may determine appropriate intervals for node 
1§J status packet transmissions based on the current interval and intervals of neighboring nodes, 
lib Moreover, the time interval between transmission of succeeding node status packets, T k+1 , may 
1?" be determined from the current interval (T k ) and the offset (8), and may be expressed as follows, 
lj* T k + 1 =T k+ S. 

ip : If the quantity of neighbors, N k , associated with the network node at a time, t k , is not 

i£t the same as the neighbor quantity, N k .„ at a prior time, t k _ ]5 as determined at step 38, the time 

W interval for succeeding node status packet transmissions, T k+1 , is not modified, and the 

22 transmission time, t k+1 , and interval, T k+1 , are respectively set at step 40 as follows: 

23 t k+1 =t k + T k 

24 T k+1 =T k . 

25 Thus, the transmission time of a succeeding packet, t k+1 , is determined based on the current 

26 transmission time (t k ) and time interval (T^). Since additional nodes are in communication with 

27 the network node, this indicates that the interval is set to a reasonable value and, therefore, 

28 should remain unchanged. The above process is repeated until termination of node processing 

29 (e.g., power down or other event) as determined at step 44. 

3 0 The manner in which a processor of a network node facilitates reception and processing 

31 of node status packets transmitted by neighboring nodes is illustrated in Fig. 3. Initially, each 



12 




1 node includes a database that stores information associated with neighboring nodes from which 

2 node status packets are received. The database basically maintains a plurality of neighbor sets, 

3 S, each including the corresponding node and neighbors from which that node receives node 

4 status packets. Thus, the database of a node having 'P' neighbors (e.g., where P is generally an 

5 integer greater than or equal to zero) includes P+l neighbor sets (e.g., a set for the node and 

6 individual sets for each of P neighbors). Specifically, the network node receives a node status 

7 packet from a neighboring node at step 50. If the neighboring node is not included within the 

8 network node neighbor set as determined at step 52, the neighboring node is added to that set at 

9 step 54. When the network node database does not include a neighbor set corresponding to the 

10 neighboring node as determined at step 56, that neighbor set is created at step 58. Since node 

11 status packets typically include neighbor information as described above, the neighbor 
12_ information within the received node status packet is examined by the network node processor 
l£ at step 60 to determine whether or not neighbors identified within the received packet are 
1 |K included within the neighbor set associated with the neighboring node. If each identified neighbor 
150 is not present within the associated neighbor set, that neighbor set is updated to include the 
163 missing neighbors at step 64. 

if* In response to determining at step 66 that the network node is identified within the 

1 If neighbor set associated with the neighboring node or within the neighbor information of the node 

1 9*. status packet, the network node establishes two-way communication with the neighboring node 

2K at step 68 . The above process is repeated until termination of node processing (e.g. , power down 

2P or other event) as determined at step 70. 

22 The manner in which a processor of a network node determines head or member status 

23 of that node to facilitate cluster formation is illustrated in Fig. 4. Initially, cluster formation is 

24 distributed among network nodes where each node determines its status as a head or member 

25 node. Node status is basically determined by each node subsequent transmission of a 

26 predetermined quantity of node status packets by that node and in response to no new neighbors 

27 being discovered and no changes within neighbor sets occurring during the node status packet 

28 transmissions. Specifically, a node status packet counter is initialized by the network node 

29 processor at step 80. The network node transmits node status packets including corresponding 

30 neighbor information at appropriate times and adjusts the interval between those transmissions 

31 as described above. In response to transmission of a node status packet as determined at step 82, 
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1 the counter is incremented at step 84. If the counter is below a predetermined threshold as 

2 determined at step 86, thereby indicating that the predetermined quantity of node status packets 

3 has not been transmitted, the network node continues to monitor transmission of node status 

4 packets and increment the counter as described above. 

5 When the packet counter accumulates a value greater than or equal to the predetermined 

6 threshold, thereby indicating transmission of a sufficient quantity of node status packets, the node 

7 processor determines at step 88 whether or not new neighbors have been discovered or a 

8 neighbor set has changed. If either of these conditions has occurred during transmission of the 

9 node status packets, the counter is re-initialized at step 80 and the processor basically waits for 

1 0 the occurrence of appropriate conditions (e.g., no new neighbors and no changes within neighbor 

1 1 sets) within succeeding sessions of node status packet transmissions (e.g., intervals where the 

12 predetermined quantity of node status packets are transmitted) as described above. The 
l|5 predetermined quantity of node status packet transmissions may be set to any desired value, 
l^j Once a session of node status packet transmissions occurs without discovering a new 
1 J3 neighbor and without changes in neighbor sets, the node processor determines at step 90 whether 
163 or not a neighbor set associated with the network node is a subset of a neighbor set of any 
1 T neighboring nodes. The neighbor sets for this determination are stored within the network node 
l |f database as described above. In other words, the processor determines for the neighbor set, S, 
1 9* associated with the network node the presence of a neighbor set ,S m , associated with another node 
2g 'm' that satisfies the condition of SeS m , where m is generally an integer from one to the quantity 
2.P of neighboring nodes. If the neighbor set associated with the network node is not a subset of any 

22 neighbor sets of neighboring nodes, this indicates that there exist some nodes within the 

23 associated neighbor set that may only establish communications through the network node. Thus, 

24 the network node is crucial to relay traffic and is designated as a head node at step 92. 

25 If the neighbor set associated with the network node is a subset of a neighbor set of a 

26 neighboring node, the node processor determines at step 94 if there exists a common neighbor 

27 set associated with the network node and each of the neighboring nodes (e.g., each neighbor set 

28 associated with the network node or neighboring nodes is equivalent to each other). In other 

29 words, the processor determines the presence of a neighbor set, C, equivalent to each neighbor 

30 set, S i? in the network node database, where *i* is generally an integer from one to a quantity of 

3 1 nodes including the network node and its neighboring nodes. This basically occurs in the event 
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1 of a flat network architecture of fully connected nodes where each node has the same neighbors, 

2 thereby producing equivalent neighbor sets. When there is no common neighbor set, this 

3 indicates that the neighbor set associated with the network node is a subset of another neighbor 

4 set as described above. Thus, the neighbors of the network node may facilitate communications 

5 through the node associated with that other neighbor set. Accordingly, the network node is not 

6 crucial to relay traffic and is designated as a member node at step 96. 

7 When a common neighbor set exists as determined at step 94, the node with the lowest 

8 identifier is designated as a head node and a master node at step 98. The master node determines 

9 the head or member node status of the remaining nodes. The head nodes are selected to have a 

1 0 predetermined quantity of member nodes associated with each head node. For example, if 'Q' 

1 1 (e.g., where Q is an integer generally greater than zero) member nodes are to be associated with 
12^ each head node, the master node designates a head node for each group of Q+l nodes. The 
123 master node informs nodes of their head node status, while remaining nodes are designated as 
144 members. 

1 ijp Once status has been determined for network nodes as described above, the head nodes 

lgl inform corresponding member nodes of the head node designations. This is typically 

1 T accomplished by the head nodes transmitting status information within the node status packets. 

18^ When a member node receives node status packets indicating that more than one neighboring 

1 9* node is designated as a head node, the member node may determine the particular head node to 

2£fi utilize for communications based on any desired criteria (e.g., strongest signal, etc.). The above 

T¥ process is repeated until termination of node processing (e.g., power down or other event) as 

22 determined at step 1 00. The network continually adjusts the interval between node status packet 

23 transmissions and performs cluster formation in response to appropriate conditions as described 

24 above. 

25 Cluster formation in accordance with the present invention is described with reference 

26 to an exemplary network illustrated in Fig. 5. Specifically, a network 20a includes nodes 10(1) - 

27 10(1 0) each substantially similar to the nodes described above and arranged with nodes 10(1) - 

28 10(4), 10(4) - 10(7) and 10(7) - 10(10) respectively in communication with each other and 

29 disposed within areas 102, 104, 106. However, node sets 10(1)- 10(3), 10(5) - 10(6) and 10(8)- 

30 1 0( 1 0) lack connectivity between those areas. Since node 1 0(4) is disposed within areas 1 02 and 

31 1 04 and node 1 0(7) is disposed within areas 1 04 and 1 06, these nodes are crucial to relay traffic 

32 between areas and, therefore, are designated as head nodes. Further, nodes 10(4) and 10(7) are 
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1 the minimum quantity of nodes that should be selected as head nodes to facilitate 

2 communications among network nodes. The remaining nodes (e.g., 10(1) - 10(3), 10(5) - 10(6) 

3 and 10(8) - 10(10)) are designated as member nodes. 

4 The neighbor sets associated with each node of exemplary network 20a are as follows: 
5 

6 S,={ 1,2,3,4} S 2 = {l,2,3,4l S 3 = {l,2,3,4} 

7 S 4 = (1,2,3,4, 5, 6, 7} S 5 = {4,5,6,7} S 6 = U,5,6,7} 

8 S 7 = {4,5,6,7,8,9, lol S 8 = { 7, 8, 9, 10 } S 9 = {7,8,9, 10 } 

9 S 10 = {7,8,9, 10} 
10 

1 1 where the subscript of a set 'S' and the corresponding set elements are in the form of reference 

1 2h numeral indices to refer to a corresponding node. For example, ' S x 9 represents the neighbor set 

l |R associated with node 10(1), while a set element '2' refers to node 10(2). The database of each 

1 33 node includes the neighbor set of that node and the neighbor sets of neighboring nodes. By way 

lS of example, the database of node 10(1) includes neighbor sets S„ S 2 , S 3 and S 4 . 

1 |rjj Each neighbor set basically includes the associated node and the neighboring nodes from 

If which the particular node receives node status packets. For example, since node 10(1) is in 

lfe communication with nodes 10(2), 10(3) and 10(4) as described above, the corresponding 

lS neighbor set, S„ includes nodes 10(1), 10(2), 10(3) and 10(4). The head or member status of 

2® node 10(1) is determined by that node based on neighbor sets of the nodes within set, S x , or sets 

21 S„ S 2 , S 3 and S 4 . Since neighbor set Sj is a subset of neighbor set S 4 , node 10(1) is not crucial to 

22 relay traffic and is designated as a member node. In other words, the nodes within set S 1 may also 

23 receive packets from node 1 0(4), thereby indicating that node 10(1) is not crucial to relay traffic. 

24 The status of node 1 0(4) is determined by that node based upon neighbor sets of the nodes 

25 within set S 4 , or sets S„ S 2 , S 3 , S 5 , S 6 and S 7 . Since set S 4 is not a subset of the neighbor sets of 

26 the remaining nodes with that set, this indicates that there exist some nodes within set S 4 that may 

27 only establish communications through node 10(4) and, therefore, node 10(4) is crucial to relay 

28 traffic and is designated as a head node. Similarly, node 10(7) determines, in the manner 

29 described above for node 10(4), that some nodes within associated neighbor set S 7 may only 

30 facilitate communications through node 1 0(7) and, therefore, node 1 0(7) is crucial to relay traffic 

3 1 and designates its status as a head node. The remaining nodes within network 20a determine their 

32 status in substantially the same manner described above. The present invention identifies nodes 
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1 10(4) and 10(7) as head nodes, thereby designating the minimum quantity of head nodes and 

2 providing a minimum quantity of hops for data transmission. The minimum hop quantity further 

3 serves to maximize message completion rate and minimize network latency. The network nodes 

4 perform the above determination based on the neighbor information received within node status 

5 packets and stored in the respective node databases as described above. 

6 Performance of the present invention has been measured with reference to an exemplary 

7 network configuration illustrated in Fig. 6. Specifically, network 20b includes nodes 10(1) - 

8 10(20) each substantially similar to the nodes described above and arranged with nodes 10(1) - 

9 10(6), 10(6) - 10(1 1), 10(1 1) - 10(16) and 10(16) - 10(20) respectively in communication with 

10 each other and disposed within areas 108, 110, 1 12 and 1 14. Nodes 10(6), 10(1 1) and 10(16) 

1 1 should be designated as head nodes, while remaining nodes within network 20b should be 

1 2 designated as member nodes. The present invention designates nodes 1 0(6), 10(1 1) and 10(16) 
l|5 as head nodes without regard to the generally random sequence of node activation. In contrast, 
1|E the techniques of the related art described above produce sub-optimal results. For example, the 
ISP lowest node identifier scheme designates at least four cluster head nodes each associated with 
1 J a respective area 108, 110, 112, 1 14. Further, that technique requires designation of gateway 
IT nodes to route traffic, whereas the present invention provides head node status to nodes that are 
1^ crucial for relaying traffic, thereby eliminating the necessity of gateway nodes. 

lgk In addition, the above-described scheme dependent upon node activation generates 

2jij different cluster formations with varying start-up sequences. In order to produce results for this 

2P scheme, a simulator employing a random number generator is utilized to simulate network 

22 behavior. The random number generator produces a random number that is associated with a 

23 particular node. Thus, corresponding nodes are initiated in accordance with the output, of the 

24 random number generator to simulate the generally random nature of network node initiation. 

25 The random number generator utilizes a base number or seed to produce a sequence of random 

26 numbers where variations in the seed alter the sequence of random numbers. Results of cluster 

27 formation by the above described node initiation scheme for varying seeds are illustrated in Table 

28 I below. 



Table I 

HEADS 

5,7, 8, 10, 11, 12, 16, 17 

3,4, 5, 6, 7, 11, 12, 16, 19 

4, 7, 8, 10, 11, 13, 16, 20 
6 

7 The head nodes indicated in the table are in the form of reference numeral indices to refer to 

8 corresponding nodes. Thus, by way of example, a head node '4' in the table refers to node 1 0(4). 

9 As shown above in Table I, the scheme designates a significantly greater quantity of cluster heads 

1 0 than the present invention, where the cluster heads are not optimal or crucial for routing traffic. 

1 1 Further, this scheme generates different cluster formations with varying seeds or node initiation 
lfh sequences, thereby being dependent upon those sequences for cluster formation. 

1 J: The performance of adjustment of the interval between node status packet transmissions 

lP has been measured on an exemplary network of one-hundred nodes randomly distributed in an 

lS area of twenty kilometers by twenty kilometers and having a radio range of approximately ten 

llu kilometers. Initially, each network node starts within a period of approximately four seconds. 

17 Subsequently, the interval between node status packet transmissions is adjusted in the manner 

lf& described above. The relationship between packet rate of the network and time is illustrated in 

l§i Fig. 7. The total packet rate is defined to be the total quantity of node status packets transmitted 

2|| divided by the elapsed time. As shown in Fig. 7, the packet rate is initially high and decreases 

21 with an increased interval to avoid collisions. Once the interval settles, cluster formation is 

22 initiated. The present invention designates twenty-two head nodes and seventy-eight member 

23 nodes for the network. The node initiation scheme described above cannot form clusters for this 

24 network since the network nodes start at approximately the same time. The present invention has 

25 been further applied to various network configurations having approximately one-hundred to 

26 three hundred fifty nodes. In each case, cluster formation was achieved even during conditions 

27 of each node starting at approximately the same time (e.g., starting within four seconds). 

28 Typically, the cluster arrangement of a network affects overhead traffic, where the amount 

29 of overhead traffic generally depends on the degree of optimal cluster formation. For example, 

30 a cluster formation technique that designates an excessive quantity of cluster head nodes severely 

31 affects overhead traffic and routing performance. In order to reduce overhead traffic within a 
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1 network, the clustering technique described above is further applied to a backbone network of 

2 head nodes to form an additional tier of super nodes as illustrated in Fig. 8. Specifically, an 

3 exemplary network 200 includes nodes 10(1) - 10(11) each substantially similar to node 10 

4 described above. Cluster formation is initially performed by the network nodes to determine 

5 head node status in substantially the same manner described above. This same clustering 

6 procedure is subsequently performed by head nodes to determine super node status. Once the 

7 head node clustering is performed, the network includes an additional tier of super nodes. By way 

8 of example, nodes 10(1) - 10(11) of network 200 are initially within a first tier 150. Cluster 

9 formation is performed by the first tier nodes where nodes 1 0(3), 1 0(6) and 1 0(9) are designated 

1 0 as head nodes 1 4(3), 1 4(6) and 1 4(9). These head nodes form a second tier 1 60 where each node 

1 1 within that tier is a head node. The head nodes of tier 1 60 perform cluster formation as described 

1 2 above and node 1 4(6) is designated as a super node 1 5(6). The super node forms a third tier 1 70. 
1 Jj When formation of the super node tier commences, a database within each second tier head node 
lit includes information relating to connectivity of its neighboring head nodes. In other words, a 
1 g database of a head node that has 'L* neighboring head nodes (e.g., where L is an integer generally 
IfiB greater than zero) includes the neighbor sets, H i5 where T is generally an integer from one 
IT through L+l (e.g., neighbor sets for the particular head node and each of its L neighboring head 
llf nodes). The neighbor sets include the associated head node and neighboring head nodes from 
lp= which the particular head node receives node status packets. The head nodes initially receive this 
2|E connectivity information from their neighboring nodes within node status packets as described 
2© above. The super node includes information relating to connectivity of its corresponding 

22 neighboring head and super nodes at termination of third tier formation. 

23 The manner in which a processor of a network node determines its status to facilitate 

24 multiple tier cluster formation is illustrated in Fig. 9. Specifically, power is enabled to the 

25 network at step 1 20 and the network node transmits and receives node status packets and adjusts 

26 the interval between those transmissions at step 1 22 in substantially the same manner described 

27 above for Figs. 2-3. Once the appropriate conditions have occurred (e.g., no new neighbors and 

28 no neighbor set changes have occurred within an interval of a predetermined quantity of node 

29 status packet transmissions), the network node determines its status as a head or member node 

30 at step 124 in substantially the manner described above for Fig. 4. 

3 1 Subsequent node status determination, the node processor determines at step 1 26 whether 
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1 or not the network node is designated as a head node. If the network node is designated as a head 

2 node, the node processor determines at step 127 whether or not each node within neighbor sets 

3 of neighboring nodes has determined its status as a head or member node. Basically, the database 

4 of a node having ' W neighboring nodes (e.g., where W is an integer generally greater than zero) 

5 includes the neighbor sets, S j5 where j is an integer from one to W+ 1 (e.g., neighbor sets for the 

6 particular node and each of its W neighboring nodes). Cluster formation with respect to network 

7 head nodes may commence by a head node when the head or member status of each node within 

8 sets, Sj, is determined. Initially, an additional head link database is constructed by each head 

9 node and includes information relating to cluster head node connectivity. For example, the head 

10 link database of a head node having *L' neighboring head nodes (e.g., where L is an integer 

1 1 generally greater than zero) from which the cluster head node may receive transmissions, 

1 2 includes neighbor sets, H i5 where 'i* is generally an integer from one through L+l (e.g., neighbor 
1 S sets for the particular head node and each of its L neighboring head nodes). The neighbor sets 
1 M include the associated head node and neighboring head nodes from which the particular head 
1 §3 node receives node status packets as described above. The super node status of the network node 
lfij is determined at step 128 in response to the nodes within the neighbor sets determining their 
lif status. Super node status of the network node is determined in substantially the same manner as 
llf the determination of head node status described above for Fig. 4. The super nodes basically 
lp= inform corresponding head nodes of the super node designations by transmitting status 
2|K information within node status packets in substantially the same manner described above for head 
2P node notification. Further, when a head node receives information indicating that more than one 

22 neighboring node is a super node, the head node may determine the particular super node to 

23 utilize for communications based on any desired criteria (e.g., signal strength, etc.) in 

24 substantially the same manner described above for member nodes selecting a head node. 

25 A flooding process occurs after formation of the super node tier and is initiated by the 

26 super nodes. Basically, flooding is the process where each head node receives routing 

27 information from other network head nodes to synchronize head link databases. Thus, the head 

28 link database of each head node includes information relating to the connectivity of head nodes 

29 within the network in response to completion of the flooding process. In particular, the network 

30 node floods a database update packet to other network super nodes at step 132 in response to 

31 determining that the network node is a super node at step 130. The flooding may be 

32 accomplished by a unicast or broadcast technique. Specifically, a unicast technique includes each 
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1 super node transmitting routing or connectivity information from its head link database or any 

2 newly received connectivity information to each corresponding neighboring super node via 

3 unicast or point-to-point messages. Since the head link database of each super node includes 

4 connectivity information of its corresponding neighboring head nodes, the head link database of 

5 each super node contains information relating to connectivity of each network head node at 

6 completion of the flooding process. The information transmitted by a super node is received by 

7 neighboring super nodes that each forward the information via unicast or point-to-point messages 

8 to head nodes associated with that super node. Since each head node contains connectivity 

9 information relating to each of its neighboring head nodes (e.g., including its corresponding super 

10 node), the super nodes need to transmit to their associated head nodes only the information 

1 1 received from neighboring super nodes. The unicast technique facilitates transmission to a 

12 destination with minimum power for nodes that may adapt transmission power. Further, since 
this technique requires a channel to be cleared prior to transmission, the possibility of collisions 

\M is reduced. However, this technique transmits a packet for each destination, thereby providing 

U£i significant overhead traffic for large networks and increasing the likelihood of collisions. 

lg As discussed above, the unicast technique basically transmits packets among super nodes 

tf and subsequently floods those packets from super nodes to associated head nodes. The broadcast 

W* technique basically includes super nodes flooding connectivity information from their head link 

1|§L database or any newly received connectivity information to each of their super node or head node 

2& neighbors. Thus, the super nodes may transmit to any neighbors regardless of super node status. 

2B Although the broadcast technique transmits without adaptive power adjustment or a guarantee 

22 of a clear channel, this technique provides significant reduction of overhead traffic. For example, 

23 one broadcast packet transmission is required to flood connectivity information for a supdr node 

24 having 'Y* associated head nodes (e.g., where Y is generally an integer greater than zero), 

25 whereas Y packet transmissions are required by the unicast technique. 

26 Once connectivity information is transmitted by super nodes, the network node in 

27 response to being designated a super node, receives the information at step 133 and forwards the 

28 information to its associated head nodes. The associated head nodes update their head link 

29 databases with the transmitted information and determine whether or not further information is 

30 required as described below. If additional information is required, the head nodes transmit 

3 1 requests to the network node to provide the requested information. Accordingly, the network 
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1 node receives requests for information from associated head nodes at step 1 34. The requests are 

2 processed by the network node and the information is transmitted via a unicast or point-to-point 

3 message to the requesting head node at step 135. The requesting node receives the information 

4 and updates its head link database to contain a complete description of head node connectivity. 

5 Once flooding has been accomplished, each head node should contain sufficient 

6 information to perform clustering and route packets. However, in order to ensure the integrity 

7 of head link databases, each head node examines its head link database for missing information. 

8 Accordingly, in response to the node processor determining at step 130 that the network node 

9 does not qualify as a super node, the network node receives and processes database update 

1 0 packets from a corresponding super node at step 136. The network node processes these packets 

1 1 in order to update its head link database. Once the flooding is complete, the network node 

12 examines its head link database for missing information at step 138. This is accomplished by 
IS examining neighbor sets within that database. In particular, each head link database should 
12M contain neighbor sets, D i5 where T is an integer from 1 through 'Z\ and Z is generally an integer 
l£ greater than zero and represents the quantity of head nodes in the network. The neighbor sets 
l^j include the associated head node and neighboring head nodes from which the particular head 
1^ node receives node status packets as described above. The network node examines each neighbor 
1$& set Dj within the head link database to uncover a set element or neighboring head node for which 
l|[ the head link database does not include a corresponding neighbor set, thereby indicating that the 
2W database is incomplete. For example, if node 14(9) (Fig. 8) is determined to be an element of the 
2d| set, D 5 , the network node examines the head link database for the neighbor set, D 9 , associated 

22 with node 14(9). When set D 9 is not within the database, the database is incomplete and the 

23 network node ascertains the missing information. 

24 In response to determining at step 140 that the database lacks information, the network 

25 node requests its corresponding super node to provide the missing information at step 142. The 

26 request is processed by the super node and the information is provided to the network node as 

27 described above. The head link database of the network node is updated with the information to 

28 provide a complete description of head node connectivity. This technique eliminates the need for 

29 head nodes to acknowledge receipt of packets from the corresponding super node. Since 
3 0 numerous acknowledgment packets may be transmitted, especially in the case where a super node 
3 1 has several associated head nodes, the amount of overhead traffic is significantly reduced. In 
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1 certain systems, an acknowledgment is incorporated into the routing protocol for a unicast 

2 message. Accordingly, a head node does not need to repeat the acknowledgment to a super node. 

3 However, with respect to a broadcast technique, an acknowledgment is typically transmitted to 

4 ensure reliability. 

5 Operation of the multiple tier architecture of the present invention is described with 

6 reference to an exemplary network configuration illustrated in Fig. 10. Initially, network 200 

7 includes head nodes 14(1) - 14(8) each substantially similar to nodes 14 described above and 

8 associated with corresponding member nodes (not shown). Network nodes 14(1) - 14(8) have 

9 been designated as head nodes in the manner described above and form a second tier of network 

1 0 200. The cluster formation technique described above is applied to the head nodes resulting in 

1 1 head nodes 14(3) and 14(8) being designated as super nodes. The super nodes flood routing 

1 2 information to synchronize head link databases as described above, where the head link database 
1 Jj of each head node should contain the following information or neighbor sets. 

im ^ = {1,2,3} D 2 = {l,2,3l D 3 = {l, 2,3,4,5,8} 

M D 4 - { 3, 4, 5, 8} D 5 = { 3, 4, 5, 8} D 6 = {6, 7, 8} 

lg D 7 = { 6, 7, 8} D 8 = { 3, 4, 5, 6, 7, 8} 

\i 

1 £ The subscript of set D and set elements represent reference numeral indices and refer to particular 

1-9: head nodes. For example, *D/ represents the neighbor set associated with head node 14(1), 

2C§ while an element *2* refers to head node 14(2). 

2T Once flooding is accomplished by super nodes 14(3) and 14(8), the head link database 

22 of each head node 14(1) - 14(2) and 14(4) - 14(7) is examined for completeness. By way of 

23 example only, node 14(1) examines its database and discovers that node 14(5) is an element of 

24 neighbor sets D 3 , D 4 and D 8 respectively associated with head nodes 14(3), 14(4) and 14(8). 

25 However, the neighbor set associated with node 14(5) is not within the database of node 14(1). 

26 Accordingly, node 14(1) transmits a request to corresponding super node 14(3) to provide the 

27 missing information. If additional information relating to a particular node is missing, this 

28 indicates that the node has a system failure or has moved out of range. For example, when the 

29 database of node 14(1) further lacks sets D 5 , D 3 , D 4 and D 8 respectively associated with 

30 uncovered node 14(5) and its neighboring head nodes 14(3), 14(4) and 14(8), node 14(5) 

3 1 typically has a system failure or has moved out of range. 
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Conventional techniques, such as the OSPF protocol, designate a particular router to 
transmit a broadcast message to neighboring routers as described above. The neighboring routers 
each transmit an acknowledgment message to the designated router in response to receiving the 
broadcast message. When the designated router does not receive a response from a neighboring 
router within a predetermined time interval, the broadcast message is re-transmitted via the 
unicast technique to the router not acknowledging the message. However, the present invention 
eliminates the requirement of transmitting an acknowledgment message, while providing a 
manner for head nodes to receive missing information from super nodes, thereby reducing 
overhead traffic. Once initial flooding and database examination are complete, each head node 
contains information sufficient to route messages. Super nodes handle flooding of database 
update packets, while head nodes provide routing functions for the network. When changes in 
network connectivity or other events occur that modify a head link database, new information 
is flooded to the head nodes to synchronize their head link databases. This is accomplished by 
a head node transmitting the information to a corresponding super node which subsequently 
floods the information as described above. This technique may be further utilized to flood 
database or other information (e.g., internal network routing protocol, ROSPF packets, etc.) to 
head and/or member nodes throughout the network. The present invention continually adjusts 
network configuration and designates head nodes and super nodes in response to appropriate 
network conditions as described above. This enables the network to adapt to changing conditions 
(e.g., units moving between clusters or unit movement causing a current configuration to be sub- 
optimal) and provide a relatively optimal configuration for routing traffic. 

The present invention may employ alternative techniques to reduce overhead traffic. In 
particular, broadcast messages may include information from plural database update packets and 
be transmitted at particular times to reduce overhead traffic. For example, when a super node 
receives new database information in the form of database update packets from neighboring 
super nodes, the information may be transmitted immediately within individual packets each 
corresponding to a received database update packet. However, this may increase packet rate, 
especially where the node is receiving database information from several other super nodes. 
Accordingly, the super nodes may transmit information accumulated from several received 
database update packets within a single cumulative packet for transmission to associated head 
nodes. Alternatively, each super node may include a timer that is initiated after adjustment of 
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1 the interval between node status packet transmissions for head node clustering. The timer 

2 indicates expiration of predetermined time intervals, and may be set to any desired value. A 

3 super node floods a message in response to receiving new routing information within each 

4 periodic interval as indicated by the timer. The message includes the routing information 

5 received during that interval. This provides a super node an opportunity to aggregate data prior 

6 to transmission in order to reduce overhead traffic. 

7 The present invention may achieve significant reductions in overhead traffic. By way of 

8 example only, the overhead traffic produced by conventional techniques and the present 

9 invention for a fully connected network (e.g., a network including nodes having direct 

1 0 communication with each other) is examined. Basically, two approaches may be utilized to flood 

1 1 database information. One approach is a conventional brute force or basic technique utilizing 

12 a flat or single level network architecture, while another approach includes the technique 
lS employed by the present invention described above. A comparison between the approaches may 
lit: be performed based on the quantity of packets transmitted (e.g., excluding re-transmissions 
1C within the flat architecture and request messages within the present invention). The packet 
l|g quantity for the present invention is measured from cluster head nodes. In other words, the 
1^ J second tier or cluster head nodes are considered as a flat architecture for the conventional 
lW= approach, and as a hierarchical architecture for the present invention subsequent clustering and 
ISl formation of the third tier. Unicast and broadcast transmission techniques are utilized for the 
2pj comparison. 

233 Basically, an exemplary network configuration includes 'N' second tier or cluster head 

22 nodes that are fully connected, where N is an integer generally greater than zero. Transmission 

23 from a single head node initiates a series of transmissions from other head nodes to flood a 

24 packet. In other words, a head node initially transmits a database update packet to N-l 

25 destination head nodes, where each destination head node transmits the packet to the remaining 

26 N-2 destination head nodes. The total packet quantity, B update , using the conventional approach 

27 may be expressed as follows: 

28 B update =(N-l) + (N-l)(N-2) = (N-l)(N-2+l) 

29 =(N-1) 2 . 
30 

3 1 The above expression provides a packet quantity for an update message received by any network 
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1 node. With respect to a database refresh (e.g., each head node transmits information from its 

2 head link database to other head nodes), each head node basically transmits a packet in the 

3 manner of an update as described above. Thus, the total packet quantity, B reft€Sh , for a database 

4 refresh (e.g., N-B update ) may be expressed as follows: 
5 

6 IW =N(N-1) 2 . 
7 

8 Referring to the present invention, upon completion of head node clustering, each head 

9 link database includes connectivity information pertaining to each network head node in response 

10 to the head nodes being fully connected. Thus, additional information is not required to be 

1 1 flooded, whereas flooding in a flat architecture is dependent upon the implementation and the 

1 2 above expression for B update provides the quantity of packets transmitted. The determination of 
\% the total packet quantity transmitted by the present invention is based on the conditions of a node 
lM receiving a database update packet from a source head node and subsequently flooding the 
l€s received packet, while node status as a head node or super node remains constant. Accordingly, 
lS a present invention head node initially transmits an update packet to its corresponding super 

■szz n 

IT node. The super node subsequently transmits the packet to the remaining associated N-2 head 

W* nodes. Thus, the packet quantity for the present invention utilizing a unicast technique, P update 

l5 (unicast)* may be expressed as: 

2 B 

2© Pupdate (unicast) = l+(N-2) = N-l. 
22 

23 When the present invention employs a broadcast technique, a first packet is transmitted 

24 from a head node to a corresponding super node, while a second packet is subsequently 

25 broadcasted from the super node to the remaining super or head nodes. Thus, the packet quantity 

26 for the broadcast technique, P updatc (broadcast)* is ec l ual to two* ^ d ma y be expressed as follows: 
27 

28 Pupdate (broadcast) — 2. 

29 

30 A graphical illustration of the relationship between the total packet quantity and quantity 

31 of head nodes for the conventional approach and the hierarchical approach of the present 
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1 invention employing unicast and broadcast techniques is illustrated in Fig. 1 1 . As shown in the 

2 figure, the present invention significantly reduces packet quantity relative to the conventional 

3 approach, especially as the quantity of network nodes increases. For example, when an 

4 exemplary network configuration includes ten head nodes, the corresponding packet quantity for 

5 the conventional approach is eighty-one, while the packet quantities for the present invention are 

6 nine for a three-tier architecture employing a unicast technique and two when employing the 

7 broadcast technique. Since clustering and routing are essential elements of self-organizing 

8 networks, such as those for ad hoc wireless communications, and since communication failure 

9 occurs in response to overhead consuming a significant portion of available bandwidth, the 

10 present invention reduces overhead traffic when flooding messages to thereby prevent 

1 1 communication failure and maintain a functioning network. 

1 2 The present invention is not limited to the networks described herein, but may be applied 
1% to any static, mobile or wireless networks (e.g., commercial or military applications, ad hoc 
ljEj wireless network, etc.). Further, the present invention may be applied to any networks requiring 
IS self-organization (e.g., military applications), or those that dynamically determine potential 
liy routes for message transmission. Accordingly, the present invention has numerous commercial 
l¥ applications in various events (e.g., earthquake, fire, flood, rescue, criminal search, etc.) or within 
II? personal communication networks (e.g., within a campus). Moreover, the present invention may 
l£k be applied in a cellular network, where a base station fails and a multi-hop wireless network is 
2ffi utilized to transmit data. 

20 It will be appreciated that the embodiments described above and illustrated in the 

22 drawings represent only a few of the many ways of implementing a method and apparatus for 

23 communication network cluster formation and transmission of node link status messages with 

24 reduced protocol overhead traffic. 

25 The communication networks employing the present invention nodes may include any 

26 quantity of those nodes or tiers. The present invention network nodes may be arranged to form 

27 any plural tier network configuration and may transmit information throughout that network 

28 configuration in the manner described above to reduce protocol overhead traffic. The network 

29 nodes may be arranged in any fashion into any quantity of clusters, cells or tiers each having any 

30 quantity of member nodes, head nodes and/or super nodes. The backbone network may include 

31 any quantity of head nodes, while communications within a cluster and between neighboring 

27 
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1 cluster head and/or super nodes may utilize the same or different transmission frequencies. The 

2 network may include any quantity of nodes, head nodes and super nodes, where each node may 

3 have any quantity of neighboring nodes. The head and super nodes may respectively have any 

4 quantity of associated member and head nodes. The variables used herein (e.g., N, P, Q, L, W, 

5 Y, Z, etc.) merely describe network and data configurations, and do not limit the present 

6 invention to any particular configuration. The variables may be any type of number (e.g., 

7 integer, real, etc.) having any desired value. The neighbor sets may include any information to 

8 identify neighboring nodes arranged in any fashion. 

9 The formation of cells and designation of head and super nodes may be predetermined 

1 0 or accomplished dynamically via the technique described above. The nodes may communicate 

1 1 via any suitable communications medium (e.g., wired or wireless communication devices, etc.). 

1 2 The present invention node may include any quantity of conventional or other transmitters, where 
1% each transmitter may transmit signals at any suitable frequency and in any suitable energy form 
l¥ ( e *g-> radio signals, microwave, optical signals, etc.), and any quantity of conventional oi* other 
1® receivers, where each receiver may receive signals at any suitable frequency and in any suitable 
lg energy form (e.g., radio signals, microwave, optical signals, etc.). Alternatively, the present 
TP invention node may include any quantity of combined transmitting/receiving devices. The node 
li& identifier may include any quantity of any types of alphanumeric or other characters or symbols 
1&l which provide the identification of a node within a sequence. The sequence may be conventional 
2j&j and known (e.g., numeric order, alphabetical order, etc.), or may be predetermined (e.g., created 
203 or constructed) and provided to the nodes. 

22 The processor of the present invention node may be implemented by any conventional 

23 or other microprocessor, controller or circuitry to perform the functions described herein, while 

24 any quantity of processors or processing devices or circuitry may be employed within the present 

25 invention node where the processor functions may be distributed in any fashion among any 

26 quantity of modules, processors or other processing devices or circuits. The software for the 

27 processor of the present invention node may be implemented in any suitable computer language, 

28 and could be developed by one of ordinary skill in the computer and/or programming arts based 

29 on the functional description contained herein and the flow charts illustrated in the drawings. 

30 Further, any references herein of software performing various functions generally refer to 

3 1 processors performing those functions under software control. The software and/or algorithms 
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1 described above and illustrated in the flow charts may be modified in any manner that 

2 accomplishes the functions described herein. The present invention node may alternatively 

3 include any components arranged in any fashion to facilitate distribution of packets within the 

4 network in the manner described above. 

5 The database update, node status and other packets or messages (e.g., acknowledgment, 

6 point-to-point message, broadcast message, etc.) may be of any size, may have any format, may 

7 contain any desired information and may be transmitted via any suitable transmission technique 

8 (e.g., unicast, broadcast, etc.). The node status packets may be transmitted at any suitable 

9 transmission rate or have any desired interval between transmissions. The initial interval 

1 0 between node status packet transmissions may be set to any desired value. This interval may be 

1 1 adjusted in response to any suitable conditions (e.g., neighbor quantity, expiration of timers, etc.). 

1 2 The interval adjustment offset may be set to any desired value or function to achieve transmission 
l3j times producing an acceptable quantity of collisions for network operation. The offset may be 
l]|f distributed among nodes in any desired fashion via any suitable function (e.g., a uniform 
\M distribution function, etc.). The timers (e.g., periodic interval timer for accumulating information 
ljU prior to transmission, etc.) maybe implemented by any conventional or other timing mechanisms 
FF (e.g., processor clock, external hardware, software, etc.) and may be set to any desired intervals 
1B^ (e.g., fractions of seconds, seconds, minutes, hours, days, etc.) for their respective functions. 
lg^ Similarly, the counter (e.g., for node status packet transmissions, etc.) may be implemented by 
2;gJ any conventional or other counting mechanisms (e.g., external hardware, software, etc.). 

20 Cluster formation to determine head and member status may be initiated in response to 

22 any suitable conditions (e.g., transmission intervals, expiration of timers, etc.),while the threshold 

23 of node status packet transmissions may be set to any desired value. The head and super nodes 

24 may be identified in any manner that determines network nodes which are required to facilitate 

25 communications within the network (e.g.,based on neighbor sets, shortest path techniques, node 

26 transmission ranges, etc.). The master node may be selected in any fashion and may 

27 subsequently determine head nodes via any conventional or other techniques. The head and 

28 super nodes may transmit any information in any manner (e.g. , within any packets, etc.) to inform 

29 neighboring nodes of the head or super node designations. Similarly, the master node may 

30 transmit any information in any manner to inform nodes of their head node status. A member or 

3 1 head node having plural head or super nodes may select a corresponding head or super node 
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1 based on any desired criteria (e.g., strongest signal, connectivity, etc.). 

2 The various messages may include any identifier to identify the type of message or 

3 packet. The node status and database update packets may be transmitted at any desired intervals 

4 and/or in response to any desired events or conditions. The flooding may utilize any unicast, 

5 broadcast or other transmission techniques either individually or in any combination, while any 

6 types of messages or other information (e.g., ROSPF information, database synchronization, 

7 routing control information, etc.) may be flooded in the manner described above. The packets 

8 transmitted in the flooding process may include any quantity of accumulated information (e.g., 

9 information received from any quantity of packets received by a node). Further, the flooded 

10 packets may include information received during particular time intervals, where the time 

1 1 interval and associated timer may be set to any desired values. 

12 The communication network may employ any suitable intranet and/or internetworking 
lS communications protocols to facilitate reception, processing and transference of messages or 
llf packets within or external of the network. The present invention may be utilized within any 
kS intranet, internetworking or other protocol to transmit or flood messages within the network in 
lj§2 accordance with that protocol. The node databases (e.g., routing, head link, etc.) may be 
1 [ 7 J implemented by any conventional database or other storage structure (e.g., processor memory, 

external memory, file, data structure (e.g., array, queue, stack, etc.), etc.) and may have any 

lgL desired storage capacity to contain any desired information. The head link or other databases 

2fi z may be examined in any manner and utilize any conventional or other techniques to determine 

223 information missing from those databases. 

22 It is to be understood that the present invention is not limited to the applications or 

23 networks described herein, but may be utilized for various communication applications or 

24 networks, especially those employing link-state based routing protocols. Further, the present 

25 invention may be applied to any applications requiring flooding of routing or any other 

26 information. 

27 From the foregoing description it will be appreciated that the invention makes available 

28 a novel method and apparatus for communication network cluster formation and transmission 

29 of node link status messages with reduced protocol overhead traffic wherein network nodes 

30 crucial for relaying network traffic are designated as head nodes to form a hierarchical network 

3 1 configuration, while this technique is further applied to those designated head nodes to form a 
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1 multiple tier architecture for flooding information with reduced overhead traffic. 

2 Having described preferred embodiments of a new and improved method and apparatus 

3 for communication network cluster formation and transmission of node link status messages with 

4 reduced protocol overhead traffic, it is believed that other modifications, variations and changes 

5 will be suggested to those skilled in the art in view of the teachings set forth herein. It is 

6 therefore to be understood that all such variations, modifications and changes are believed to fall 

7 within the scope of the present invention as defined by the appended claims. 
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